With just a few minutes of an audio sample, ElevenLabs can clone your voice.
The unicorn start-up, co-founded by two Polish friends, Piotr Dabkowski and Mateusz Staniszewski, has developed a model that can generate a variety of realistic voices from text or pre-existing speech, and be used for dubbing, so that one can appear to sound fluent across 29 languages.
While only two years old, the company is valued at $1.1 billion and received $80 million from Andreessen Horowitz and others in January. The startup has since partnered with several large brands including HarperCollins, the Washington Post, and TIME.
ElevenLabs’s model is more robust, has a lower latency, and higher quality than competitors. Dabkowski expects the model to soon hit a “quality ceiling,” where the AI is indistinguishable from any human it mimics.
This poses an obvious safety challenge as it could be used to fraudulent ends, but Dabkowski says that their systems monitor usage to minimize the threat. “We can trace back every single generation, and you need to use your credit card to have access to voice cloning—so it's like using a gun that is connected to the internet,” he says.
ElevenLabs has developed a speech classifier that can identify whether any audio was generated using their model. The company is also a member of the U.S. AI Safety Institute’s Consortium. Open-source AI audio solutions are a larger concern, Dabkowski adds. Still, some have found ways around some of ElevenLab’s safeguards, and the terrain is constantly evolving, so preventing its misuse may not be so simple.
Buy your copy of the TIME100 AI issue here
*Disclosure: TIME and ElevenLabs have a technology agreement to create audio accessible content.
More Must-Reads from TIME
- The 100 Most Influential People in AI 2024
- Inside the Rise of Bitcoin-Powered Pools and Bathhouses
- How Nayib Bukele’s ‘Iron Fist’ Has Transformed El Salvador
- What Makes a Friendship Last Forever?
- Long COVID Looks Different in Kids
- Your Questions About Early Voting , Answered
- Column: Your Cynicism Isn’t Helping Anybody
- The 32 Most Anticipated Books of Fall 2024
Contact us at letters@time.com